14. objective function, gradient and optimizer

M8l2 17 Objective Function Gradient V1

Optimization Overview in Scipy

This Scipy link “Mathematical optimization” is a good reference on the various optimizers that are available in scipy. In addition to the L-BFGS method, other optimizers worth trying are Powell, Nelder-Mead, and Conjugate Gradient optimizers.

This course website
also contains insightful explanation of various optimization algorithms.